Protecting content displayed on a mobile device

ABSTRACT

A system for protecting content includes a mobile device screen including a plurality of pixels, whereby each of the plurality of pixels have first sub-pixel units that include a first viewing angle and second sub-pixel units that include a second viewing angle. Within each of the plurality of pixels, the first sub-pixel units are adjacent to the second sub-pixel units. A processing unit is coupled to the mobile device screen and determines a portion of the mobile device screen that displays sensitive content. The processing unit obscures the sensitive content displayed on the portion of the mobile device screen by deactivating the first sub-pixel units at the portion of the mobile device screen that displays the sensitive content and activates the second sub-pixel units at the portion of the mobile device screen that displays the sensitive content.

BACKGROUND

The present invention generally relates to mobile devices, and moreparticularly, to protecting sensitive content displayed on mobiledevices.

Many of today's software applications may operate on multiple mobiledevices, especially since an individual user can execute them ondifferent platforms (Android, Apple, Windows, Blackberry, etc.). Whenthese applications execute, confidential/sensitive information may beaccordingly transferred between mobile devices. Suchconfidential/sensitive information may, however, be required to beviewed by a specific individual(s) only. Unauthorized viewers nearby maytherefore be able to gain access to this confidential/sensitiveinformation displayed on the mobile device. This risk of theunauthorized viewing of confidential/sensitive information on mobiledevices is becoming ever more prevalent due to the mass proliferationand utilization of these devices.

BRIEF SUMMARY

According to one embodiment, a system for protecting content includes amobile device screen including a plurality of pixels, where each of theplurality of pixels have both first sub-pixel units that include a firstviewing angle and second sub-pixel units that include a second viewingangle. Within each of the plurality of pixels, the first sub-pixel unitsare adjacent to the one of the second sub-pixel units. A processing unitis coupled to the mobile device screen such that the processing unitdetermines at least a portion of the mobile device screen that displayssensitive content. The processing unit obscures the sensitive contentdisplayed on the at least a portion of the mobile device screen bydeactivating the first sub-pixel units including the first viewing angleat the portion of the mobile device screen that displays the sensitivecontent and activates the second sub-pixel units including the secondviewing angle at the portion of the mobile device screen that displaysthe sensitive content.

According to another exemplary embodiment, a method of protectingcontent displayed on a mobile device screen is provided. The methodincludes receiving content to be displayed on the mobile device screen,where the received content contains sensitive content and non-sensitivecontent. An image of one or more authorized users viewing the mobiledevice screen is detected, whereby, based on the detected image of theone or more authorized users, an image of the received content isgenerated on the mobile device screen using a plurality of pixels. Theplurality of pixels each have both first sub-pixel units that include afirst viewing angle and second sub-pixel units that include a secondviewing angle. The first sub-pixel units generate an image of thenon-sensitive content on the mobile device screen at the first viewingangle and the second sub-pixel units generate an image of the sensitivecontent on the mobile device screen at the second viewing angle, suchthat, the second viewing angle has a smaller viewing angle relative tothe first viewing angle for obscuring the sensitive content.

According to yet another exemplary embodiment, a computer programproduct for protecting content displayed on a mobile device is provided.The computer program product includes a computer readable storage mediumthat is readable by a processing circuit and stores instructions forexecution by the processing circuit for performing a method. The methodincludes instructions for receiving content to be displayed on themobile device screen, where the received content contains sensitivecontent and non-sensitive content. An image of one or more authorizedusers viewing the mobile device screen is detected, whereby, based onthe detected image of the one or more authorized users, an image of thereceived content is generated on the mobile device screen using aplurality of pixels. The plurality of pixels each have both firstsub-pixel units that include a first viewing angle and second sub-pixelunits that include a second viewing angle. The first sub-pixel unitsgenerate an image of the non-sensitive content on the mobile devicescreen at the first viewing angle and the second sub-pixel unitsgenerate an image of the sensitive content on the mobile device screenat the second viewing angle. An image of one or more unauthorized usersviewing the mobile device screen may be detected, whereby, based on thedetected one or more unauthorized users, a blank or any othernon-sensitive image on the mobile device screen is generated.

The method may include instructions to generate an image on the mobilescreen using a plurality of pixels, where the plurality of pixels eachhave both first sub-pixel units that include a first viewing angle andsecond sub-pixel units that include a second viewing angle. At least aportion of the image contains sensitive content. The method alsoincludes instructions to detect one or more unauthorized users viewingthe displayed image. The method further includes instructions to obscurethe sensitive content from the one or more detected unauthorized usersby deactivating the first sub-pixel units including the first viewingangle at the portion of the mobile device screen that displays thesensitive content and activating the second sub-pixel units includingthe second viewing angle at the portion of the mobile device screen thatdisplays the sensitive content.

According to yet another exemplary embodiment, a system for protectingcontent that includes a mobile device screen is provided, whereby thescreen includes a plurality of pixels each having both first sub-pixelunits that emit visible light and second sub-pixel units that emitinfrared (IR) light. Within each of the plurality of pixels the firstsub-pixel units are adjacent to the second sub-pixel units. A processingunit is coupled to the mobile device screen, whereby the processing unitdetermines at least a portion of the mobile device screen that displayssensitive content. The processing unit obscures the sensitive contentdisplayed on the at least a portion of the mobile device screen byactivating the second sub-pixel units at the portion of the mobiledevice screen that displays the sensitive content.

BRIEF DESCRIPTION OF THE SEVERAL VIEWS OF THE DRAWINGS

FIG. 1 shows a mobile device screen content protection concept based onviewing angle, according to one embodiment;

FIGS. 2A and 2B show a pixel structure associated with the mobile devicescreen that protects against the viewing of sensitive or confidentialcontent, according to one embodiment;

FIG. 3A depicts a wider viewing angle generated by a wide-anglesub-pixel unit at each pixel position of the mobile device screen,according to one embodiment;

FIG. 3B depicts a narrower viewing angle generated by a narrow-anglesub-pixel unit at each pixel position of the mobile device screen,according to one embodiment;

FIG. 4A shows exemplary content having sensitive information that isdisplayed on the mobile device screen when an authorized user is viewingthe screen, according to one embodiment;

FIG. 4B shows the obscuring of the sensitive information that isdisplayed on the mobile device screen depicted FIG. 4A, according to oneembodiment;

FIG. 5A depicts a flowchart of a process (i.e., a Mobile Device ScreenContent-Protection Program: a MDSC program) for protecting confidentialor sensitive content from being viewed by an unauthorized user,according to one embodiment;

FIG. 5B depicts a flowchart of a process for determining one or moreunauthorized users and/or external camera devices within the process ofFIG. 5A, according to one embodiment; and

FIG. 6 is a block diagram of hardware and software for executing theprocess flows of FIGS. 5A-5B within a mobile device, according to oneembodiment.

The drawings are not necessarily to scale. The drawings are merelyschematic representations, not intended to portray specific parametersof the invention. The drawings are intended to depict only typicalembodiments of the invention. In the drawings, like numbering representslike elements.

DETAILED DESCRIPTION

Detailed embodiments of the claimed structures and methods are disclosedherein; however, it can be understood that the disclosed embodiments aremerely illustrative of the claimed structures and methods that may beembodied in various forms. This invention may, however, be embodied inmany different forms and should not be construed as limited to theexemplary embodiments set forth herein. Rather, these exemplaryembodiments are provided so that this disclosure will be thorough andcomplete and will fully convey the scope of this invention to thoseskilled in the art. In the description, details of well-known featuresand techniques may be omitted to avoid unnecessarily obscuring thepresented embodiments.

The one or more exemplary embodiments described herein may be directedto a system, method, and apparatus that may include, among other things,a display system involving an adaptive beam steering mechanism (e.g.controlled collimators or optical phased array), that allows thedirecting (focusing) of visual information towards a specific spatialposition associated with an authorized viewer or user. For example,according to one embodiment, a closed loop control system using a mobiledevice's camera(s) may track the eyes (or other facial feature) of anauthorized individual and direct the visual content from the mobiledevice display in such a manner that only make the content visible atthe location of the authorized individual's eyes (or other facialfeatures). Thus, no replicas may be taken by another camera that islocated away from the geometric position of the authorized individual'seyes. According to another embodiment, the divergence angle of thedisplayed content is varied according to whether sensitive content isbeing displayed. Accordingly, portions of the screen displaying thesensitive content include a narrower viewing angle, while thenon-sensitive content remains displayed with a wider viewer, as providedby the standard display characteristics of the mobile device. Anauthentication process may, in some embodiments, exclusively enable theprojection of sensitive information based on the identification of theauthorized individual(s) and accordingly no content replication threat.Further embodiments may include a time-based mechanism that enforces therule that the sensitive information can only be available for acontrolled period of time (e.g., 5 minutes, etc.).

Sensitive or confidential content/information is used synonymously toinclude any information or content that is either legally confidentialor identified by a user (i.e., an authorized user) as being only for theeyes of the user themselves, or any one or more other persons authorizedby this user. For example, a user may wish to obscure their financialinformation displayed on their mobile device while seated in a plane.Similarly, an organization may wish to obscure some or all of theircorporate information displayed on the mobile devices of theiremployees.

FIG. 1 shows a mobile device screen content protection concept based onviewing angle, according to one embodiment. FIG. 1 may depict, amongother things, a mobile device 101 with a screen 102, one or moreauthorized viewers or users 104, and one or more unauthorized viewers orusers 106. Mobile device screen 102 may have a viewing angle Φ thatdefines a viewing region 108 (i.e., a cone of viewing). Viewing angle Φmay have, among other things, an angle of inclination θ of approximatelyten degrees with respect to a surface 111 normal to the mobile devicescreen 102. An unauthorized user 106 may be attempting to view mobiledevice screen 102 from a viewing angle greater than the viewing angle Φ,and may, therefore, be considered to be outside of viewing region 108.Consequently, unauthorized user 106 may be unable to view the contentdisplayed on mobile device screen 102.

FIG. 2A shows a pixel structure 200A associated with a mobile devicescreen that protects against the viewing of sensitive or confidentialcontent, according to one embodiment. Pixel structure 200A mayaccordingly include a plurality of pixels for a mobile device screen201A having one or more pixels 202A, and an optional optical beamsteerer 210A for directionally controlling the illumination direction ofthe displayed image output from the mobile device screen 102 (FIG. 1).The one or more pixels 202A each include respective red, green, and bluesub-pixel units 204A, 204B, and 204C having a first viewing angle, andrespective red, green, and blue sub-pixel units 206A, 206B, and 206Chaving a second viewing angle. The second viewing angle may be generatedto be narrower than the first viewing angle by using one or more opticalcollimators implemented using, for example, one or more optical lenses(see FIGS. 3A & 3B). In some implementations, a beam steerer 210A may beoptionally utilized to spatially alter the direction of the pixelillumination output from respective red, green, and blue sub-pixel units206A, 206B, and 206C.

Alternatively, the viewing angle of sub-pixel units 204A-204C and theviewing angle of sub-pixel units 206A-206C may be substantially the sameor similar. The one or more optical collimators implemented using, forexample, one or more optical lenses (see FIGS. 3A & 3B) may then be usedto decrease the viewing angle of both sub-pixel units 204A-204C and206A-206C. Optional beam steerer 210A may be further utilized toaccordingly direct the sensitive or confidential content towards, forexample, the eyes of an authorized user 104 (FIG. 1).

In operation, content may be displayed on the one or more pixels 202Ausing the sub-pixel units 204A-204C and, optionally, sub-pixel units206A-206C. Upon detecting an unauthorized viewer, at the pixel locationsdisplaying sensitive content, the wider viewing angle sub-pixel units204A-204C displaying the content may be deactivated, while the adjacentnarrower viewing angle sub-pixel units 206A-206C are activated. Thus,the use of sub-pixel units 206A-206C to display sensitive content maydecrease the viewing angle with respect to the mobile device screen 102(FIG. 1), which may prevent unauthorized users from attempting to viewthe content displayed on the mobile device from, for example, “over theshoulder” of an authorized viewer.

FIG. 2B shows an alternative pixel structure 200B associated with amobile device screen that protects against the viewing of sensitive orconfidential content, according to one embodiment. Pixel structure 200Bmay accordingly include a plurality of pixels for a mobile device screen201B having one or more pixels 202B, and an optional optical beamsteerer 210B for directionally controlling the illumination direction ofthe displayed image output from the mobile device screen. The one ormore pixels 202B may include respective red, green, and blue sub-pixelunits 204A, 204B, and 204C having a first viewing angle; respective red,green, and blue sub-pixel units 206A, 206B, and 206C having a secondviewing angle; and one or more infrared (IR) sub-pixel units 208associated with each pixel 202B. The second viewing angle may begenerated to be narrower than the first viewing angle by using one ormore optical collimators implemented using, for example, one or moreoptical lenses (see FIGS. 3A & 3B). In some implementations, a beamsteerer 210B may be optionally utilized to spatially alter the directionof the pixel illumination output from respective red, green, and bluesub-pixel units 206A, 206B, and 206C. The one or more IR sub-pixel unitsmay be, for example, an IR light-emitting diode or other source ofinfrared light.

Although one or more infrared (IR) sub-pixel units 208 are associatedwith each pixel 202B, in alternative implementations, one IR pixel perN-group of pixels may be utilized. For example, one of the sub-pixelunits 208 may be placed for every group of four (i.e., N=4) pixels, asindicted by group 215. Thus, fewer infrared (IR) sub-pixel units 208within the plurality of pixels 202B forming mobile device screen 201Bmay be used, so long as, the emitted IR light from each one of the IRsub-pixel units 208 substantially overlaps the visible light generatedby the red, green, blue sub-pixel units 206A, 206B, 206C associated withthe pixels 202B within its respective group. In the given example, eachIR sub-pixel unit 208 emission substantially overlaps the visible lightgenerated by the red, green, and blue sub-pixel units 206A, 206B, 206Cof each of the four pixels 202B within group 215.

It may be appreciated that IR light sources may alternatively beembedded within the periphery of the mobile device screen so as to notadversely affect the resolution of the mobile device screen. In contrastto activating all the IR light sources within the periphery of themobile device screen, exhibiting control over IR sub-pixel units on aper pixel basis at pixel locations on the screen 201B where sensitive orconfidential content is display, reduces battery power consumption.Instead of activating all the IR emitter devices, such as in the displayperiphery approach, only those IR sub-pixel units used to obfuscatesensitive or confidential content from an external camera may beactivated.

In operation, non-sensitive content may be displayed on the one or morepixels 202B using the sub-pixel units 204A-204C. Upon detecting anunauthorized viewer, at the pixel locations displaying sensitivecontent, the wider viewing angle sub-pixel units 204A-204C displayingthe content may be deactivated, while the adjacent narrower viewingangle sub-pixel units 206A-206C are activated. Thus, the use ofsub-pixel units 206A-206C to display sensitive content may decrease theviewing angle with respect to the mobile device screen 102 (FIG. 1),which may prevent unauthorized users from attempting to view the contentdisplayed on the mobile device from, for example, “over the shoulder” ofan authorized viewer.

Additionally, the one or more IR sub-pixel units 208 may activate upondetection of an external camera 109 (FIG. 1) by the mobile device 101(FIG. 1) and generate IR light. The IR light may accordingly be used tosaturate an image sensor (e.g., CMOS or CCD sensor) of the externalcamera 109 to the mobile device 101 in order to prevent the externalcamera 109 from recording or capturing sensitive content displayed onthe screen of the mobile device 101. As previously described, theviewing angle of sub-pixel units 204A-204C and the viewing angle ofsub-pixel units 206A-206C may, alternatively, be substantially the sameor similar. In some implementations, the IR light source (e.g., IRsub-pixel units 208) may be turned on every time sensitive orconfidential information is displayed. This may be done for mobiledevices that do not have a camera or a method to identify the personwatching the display. Furthermore, the IR light source may be turned onas a measure to ensure that the content of the display is not copiedeven by the authorized user (i.e. a user authorized to only view theinformation but not to make a copy of the information).

Alternatively, the viewing angle of sub-pixel units 204A-204C and theviewing angle of sub-pixel units 206A-206C may be substantially the sameor similar. The one or more optical collimators implemented using, forexample, one or more optical lenses (see FIGS. 3A & 3B) may then be usedto decrease the viewing angle of both sub-pixel units 204A-204C and206A-206C. Optional beam steerer 210B may be further utilized toaccordingly direct the sensitive or confidential content towards, forexample, the eyes of an authorized user 104 (FIG. 1).

Still referring to FIG. 2B, each of the pixels 202B may include only thesub-pixel units 204A-204C that have a conventional (i.e., wider) viewingangle and one or more IR sub-pixel units 208. In such a display screenconfiguration, narrower viewing angle sub-pixel units such as sub-pixelunits 206A-206C are omitted.

Referring to FIGS. 3A-3B, exemplary views of a controlled collimator forchanging the viewing angle of one or more sub-pixel units 206A-206Cwithin the pixel structures of FIGS. 2A-2B are depicted. In FIG. 3A, alens 302 may be placed a distance of length f₁ on top of sub-pixel units206A-206C. Light that is generated by sub-pixel units 206A-206C andtransmitted through lens 302 may accordingly have a viewing area of sizeA₁. In FIG. 3B, the distance between lens 302 and the sub-pixel units206A-206C is increased to a length f₂. Consequently, at f₂, the lightthat is generated by sub-pixel units 206A-206C and transmitted throughlens 302 may have a decreased viewing area of size of A₂, which maysubsequently decrease the viewing angle of sub-pixel units 206A-206C. Itmay be appreciated that the distance between lens 302 and sub-pixels206A-206C may be changed using, for example, a microelectromechanicalsystem (MEMS). Additionally, further increases in the distance betweenlens 302 and sub-pixel units 206A-206C may lead to a further decrease inthe viewing area and, therefore, viewing angle. Distances f₁ and f₂ mayvary in relation to the focal length f of the lens 302. For example, ata distance equal to the focal length f, the lens 302 will generate acollimated output from the illumination produced by the sub-pixel units206A-206C. At distance f₁, the position of the lens 302 relative to thesub-pixel units 206A-206C is less than the focal length f and, thus, thelens generates an output that has a divergence angle of θ₁. At f₂, thedistance of the lens 302 relative to the sub-pixel units 206A-206C isincreased relative to f₁ but still remains less than the focal length f.Therefore, the divergence angle of the output of lens 302 reduces to θ₂relative to θ₁. Thus, by manipulating the lens 302 or a system oflenses, the divergence angle and field of view may be changed. Forexample, in some implementations, the extent by which the divergenceangle changes may be controllably varied based on the level ofsensitivity or confidentiality of the content to be displayed.Accordingly, the more sensitive the content, the smaller the divergenceangle and field of view created by the lens 302.

In some implementations, a film may be embedded within the display suchthat different viewing angles may be activated by applying a potential(e.g., voltage) in order to vary the optical characteristics of thefilm. For example, the refractive index of the film may be increased tolimit light at glancing angles to escape the display. Increasing therefractive index of the film changes the critical angle (i.e., the angleat which light is totally internally reflected as dictated by Snell'sLaw). For example, by applying a first voltage to a film embedded withinthe screen 102 (FIG. 1), the film will exhibit a first refractive index(n₁) that reflects the visible light output from the pixels 202B (FIG.2B) according to first angular relationship that generates a viewingarea of size A₁ (FIG. 3A). Alternatively, by applying a second voltageto the film embedded within the screen 102 (FIG. 1), the film willexhibit a second refractive index (n₂) that reflects the visible lightoutput from the pixels 202B (FIG. 2B) according to second angularrelationship that generates a viewing area of size A₂ (FIG. 3B). Thus,varying the potential to the film generates different viewing anglesbased on the sensitivity of the content to be display.

Pixel positions of an authorized user viewing the mobile device screenare determined using the captured camera image (e.g., using facialrecognition techniques). In operation, mobile device 101 (FIG. 1) mayuse the images generated by camera 103 (FIG. 1) to determine thelocation of authorized user 104 (FIG. 1) with respect to the surface 113(FIG. 1) of mobile device screen 102 (FIG. 1). Mobile device 101 maythen use this position to determine an angle by which beam steerer 210B(FIG. 2B) may divert the light output of sub-pixel units 206A-206C (FIG.2B) towards the authorized user 104 (FIG. 1), contingent upon nounauthorized users being within the field of view of the camera 103(FIG. 1). The beam steering may be implemented optionally, inparticular, during instances when the user is moving relative to thedisplay screen 102 of the mobile device 101. The beam steering featuremay play yet a more significant role when the activated narrow-anglesub-pixel units 206A-206C (FIG. 2B) generate narrow fields of view 108(FIG. 1) capable of being viewed over a relatively narrow angular rangeθ, Φ (FIG. 1). It may be appreciated that many different phased arrayoptical beam steering technical may be utilized. Non-limiting examplesof phased array optical beam steering may include a blazed transmissiongrating used for beam steering, liquid crystal steering, liquid crystalpolarization grating steering, lenslet array-based beam steering,MEMS-mirrors beam steering, vertical continuous optical phased arrays(V-COPA) beam steering, etc.

The output from the narrow-angle pixel subgroups located at theidentified pixel positions associated with the portions of the screenthat will display the sensitive or confidential content are optionallydiverted to the authorized user viewing the screen. In operation, beamsteerer 210B (FIG. 2B) may direct the output from sub-pixel units206A-206C (FIG. 2B) such that the sensitive or confidential contentdisplayed on mobile device screen 102 (FIG. 1) is diverted towards theauthorized user 104 (FIG. 1). For example, referring to front view 305in FIG. 3B, the output 307 from narrow-angle sub-pixel units 206A-206C,which display sensitive/confidential content, may be optionally steeredto the authorized user 104 (FIG. 1) viewing the mobile device screen 102(FIG. 1) along both a horizontal direction d₁ and a vertical directiond₂.

FIG. 4A shows an exemplary view 400A of a mobile device screendisplaying sensitive information when an authorized user is viewing thescreen, according to one embodiment. Accordingly, the exemplary opticalarrangement depicted in FIG. 3A may be utilized. View 400A may include,among other things, content 402A that may include one or more regions404 having non-sensitive content and one or more regions 406 thatcontain sensitive content. In operation, an authorized viewer may beable to read all of the content 402A in view 400A without any portion ofcontent 402A being obscured. For example, both the authorized viewer oruser 104 (FIG. 1) and the unauthorized viewer or user 106 (FIG. 1) areable to view both the non-sensitive content within one or more regions404 and the sensitive content corresponding to one or more regions 406.

FIG. 4B shows an exemplary view 400B of the obscuring of the sensitiveinformation that is displayed on the mobile device screen depicted FIG.4A, according to one embodiment. Accordingly, the exemplary opticalarrangement depicted in FIG. 3B may be utilized. As with FIG. 4A, View400B also includes content 402A, which includes one or more regions 404having non-sensitive content and one or more regions 406 that containsensitive content. View 400B may be visible to an unauthorized user 106(FIG. 1) attempting to view the screen from an oblique angle relative tothe screen. For example, region 404 containing non-sensitive content maybe able to be read without obscurity by the unauthorized user 106, whileregion 406 having the sensitive content may appear obscured to theunauthorized user 106 in order to prevent the sensitive content frombeing viewed from, for example, “over the shoulder” of the authorizedviewer 104 (FIG. 1). It may be appreciated that, as a preference, all ofcontent 402A may be protected as sensitive content.

FIG. 5A depicts an operational flowchart 500 corresponding to a process(i.e., a Mobile Device Screen Content-Protection Program: a MDSCprogram) for protecting confidential or sensitive content from beingviewed by an unauthorized viewer, according to one embodiment. Theoperational flowchart 500 may be described with the aid of the exemplaryembodiments of FIG. 1 and FIG. 2B.

At 502, content to be displayed on a mobile device screen 102 (FIG. 1)is received by the mobile device screen 102 for analysis prior to beingdisplayed. The received content to be displayed on mobile device screen102 may, however, contain, among other things, sensitive or confidentialinformation to be viewed by only an authorized viewer or user 104 (FIG.1).

For example, content may be displayed on mobile device screen 102(FIG. 1) to user 104 (FIG. 1) using sub-pixel units 206A-206C (FIG. 2B),sub-pixel units 204A-204C (FIG. 2B), or a combination of both sub-pixelunits 206A-206C and sub-pixel units 204A-204C. As described by thefollowing processes, analysis of the content may ascertain which ofsub-pixel units 206A-206C (FIG. 2B) and sub-pixel units 204A-204C (FIG.2B) are activated based on the content to be displayed on the mobiledevice screen 102 (FIG. 1) to the user 104 (FIG. 1).

At 504, based on the analysis of the received content (502), adetermination is made as to whether the received content containssensitive or confidential content. For example, mobile device 101(FIG. 1) may process the received content and determine if this contentto be displayed on the mobile device screen 102 (FIG. 1) is directed tosensitive or confidential information. An unauthorized user 106 (FIG. 1)may attempt to view content containing sensitive or confidential contenton mobile device screen 102. Prior to displaying this content, mobiledevice 101 may determine whether sensitive content is going to bedisplayed on the mobile device screen 102. If, however, it is determined(504) that no sensitive or confidential information is present in thereceived content, at 505, the mobile device 101 will continue to displaythe non-sensitive or non-confidential information on the mobile devicescreen 102, while receiving more content for display and analysis (502,504). For example, at 505, based on a determination that the receivedcontent does not contain sensitive or confidential content (504), thereceived content is displayed on the mobile device screen 102 (FIG. 1)using the wide angle sub-pixel units 204A-204C (FIG. 2B). Thus, awide-angle viewing mode is employed since there is no detected sensitiveor confidential content to be displayed.

At 506, based on a determination that the received content does containsensitive or confidential content (504), an image of one or more userscapable of viewing the mobile device screen is captured using a camera.In operation, a camera 103 (FIG. 1) embedded within mobile device 101(FIG. 1) may capture an image of one or more users such as authorizeduser 104 (FIG. 1) and unauthorized user 106 (FIG. 1) that are capable ofviewing the mobile device screen 102 (FIG. 1). The captured image may beused, among other things, to determine whether the user attempting toview the content displayed on mobile device screen 102 is authorized toview the sensitive or confidential content.

At 510A, it is first determined whether the captured image (506)includes an image of one or more unauthorized users. In operation,mobile device camera 103 (FIG. 1) may capture images of one or moreusers viewing the screen. The captured images are then compared to oneor more reference images to categorize users as an authorized user 104(FIG. 1) or an unauthorized user 106 (FIG. 1).

If at 510A it is determined that the captured image (506) does notinclude one or more unauthorized users 106 (FIG. 1), then at 511, basedon the detection of sensitive content (504), one or more pixel positionsassociated with at least a portion of the mobile device screen that willdisplay the sensitive or confidential content are determined. Inoperation, mobile device 101 (FIG. 1) may determine a plurality of oneor more pixels from among the plurality of pixels 201B (FIG. 2B) thatwill display the sensitive content. The one or more pixel positionsdisplaying the sensitive or confidential content may then requireprotection from an attempt to be viewed by an unauthorized user 106(FIG. 1).

In some implementations, the determination of sensitive content orinformation (504) may be accomplished using various criteria such as,but not limited to, keywords, symbols, or phrases. For example, thesymbol “$” may determine that financial information is being displayed.Thus, any numerical information following the “$” may signify pixelspositions that require obfuscation and protection from unauthorizedeyes. In other implementations, the determination of sensitive contentor information (504) may be carried out by an authorized user. Forexample, the authorized user 104 (FIG. 1) may select confidentialportions of information displayed on a screen. Once selected, theauthorized user 104 (FIG. 1) can subsequently tag the selected portionsof information as being sensitive or confidential content. Anysubsequent processing of the tagged information will then provide anindication that the information is directed to sensitive or confidentialcontent. Certain other parameters within the mobile device 101 (FIG. 1)may also trigger a determination of sensitive or confidential content(504). For example, if the mobile device 101 (FIG. 1) is set to airplanemode (i.e., a flight safe mode that disables radio frequencycommunications on the mobile device), all displayed content is defaultedas sensitive or confidential. This determination is based on anassumption that the authorized user 104 (FIG. 1) is seated on anaircraft in close proximity to a fellow passenger. Thus, all displayedcontent is protected from being viewed by adjacent passengers.

If at 510A it is determined that the captured image (506) does includeone or more unauthorized users 106 (FIG. 1), then at 507, a blank orother predefined non-sensitive content display is generated. Forexample, a blank display may include an entirely black or uniformcolored display screen (e.g., all white screen). Alternatively, thescreen may display a banner warning the user that the display 102(FIG. 1) of the mobile device 101 (FIG. 1) is in view of an unauthorizeduser 106. The warning may provide further instructions to the user forenabling the display of the image including the sensitive content. Theprocess may also return to 502, whereby the same received content may bere-processed through 504, 506, and 510A.

As previously described, once sensitive content is detected (504) andthe captured image (506) does not include one or more unauthorized users(510A), at 511 one or more pixel positions associated with at least aportion of the mobile device screen that will display the sensitive orconfidential content are determined. Subsequently, at 510B it isdetermined whether an external camera device or plural devices image isdetected within the field of view of the mobile device camera or pluralcameras. For example, the presence of an image of external camera 109(FIG. 1) within the field of view of the camera 103 (FIG. 1) of mobiledevice 101 (FIG. 1) is determined.

If at 510B, an external camera device image is detected within the fieldof view of the mobile device camera, at 512 IR sub-pixel unitsassociated with the mobile device display screen are activated. Aspreviously described, each of the pixels 202B (FIG. 2B) of the mobiledevice screen 102 (FIG. 1) may include one or more IR sub-pixel units208 (FIG. 2B). Thus, if at 510B an image of, for example, externalcamera device 109 (FIG. 1) is detected within the field of view of themobile device camera 103 (FIG. 1), the mobile device 101 (FIG. 1)activates the one or more IR sub-pixel units 208 at the identified pixelpositions corresponding to the sensitive or confidential content (511).

Once the IR sub-pixel units generate an IR background (512), at 514 thereceived content (502) is displayed by deactivating the wide-anglesub-pixel units at the identified pixel positions associated with theportions of the screen that will display the sensitive or confidentialcontent and activating the narrow-angle sub-pixel units at theidentified pixel positions associated with the portions of the screenthat will display the sensitive or confidential content. For example,the mobile device 101 (FIG. 1) may deactivate wide-angle sub-pixel units204A-C (FIG. 2B) and activate narrow-angle sub-pixel units 206A-C (FIG.2B) in order to decrease the viewing angle of the mobile device screen102 (FIG. 1) at the pixel positions of the sensitive or confidentialcontent (514). Thus, by narrowing the field of view based on activatingnarrow-angle sub-pixel units 206A-C (FIG. 2B), the sensitive content atthe pixel positions of narrow-angle sub-pixel units 206A-C (FIG. 2B)appear obfuscated (e.g., dark and unreadable) to the one or moreunauthorized users 106 (FIG. 1) attempting to view the mobile devicescreen 102.

With respect to the activated IR background (512), by overlapping theoutput of the narrow angle sub-pixel units 206A-C (FIG. 2B) located atthe pixel positions of the sensitive or confidential content, the imagesensor of the external camera device 109 (FIG. 1) is saturated andcannot image the sensitive or confidential content. Thus, the authorizedusers are unable to reproduce an image of the displayed sensitive orconfidential content using an external image capture device (e.g., acamera). In some implementations, all of the IR sub-pixel units 208(FIG. 2B) within the plurality of pixels 201B (FIG. 2B) may be activated(i.e., battery capacity permitting) for enhancing the saturationcapability. The IR light intensity from the IR sub-pixel units 208 (FIG.2B) may be chosen to be at least a hundred times (×100) larger than thephoton flux emitted by the visible sub-pixel units 204A-204B, 206A-206B(FIG. 2B).

Optionally, the activated narrow-angle sub-pixel units 206A-C (FIG. 2B)may obfuscate the sensitive or confidential content for a predeterminedperiod of time (e.g., 5 minutes). After expiry of this predeterminedperiod of time, the pixel positions corresponding to the activatednarrow-angle sub-pixel units 206A-C (FIG. 2B) are deactivated, while theadjacent wider-angle sub-pixel units 204A-C (FIG. 2B) at the same pixelpositions are activated. In this implementation, content protection mayoccur over as pre-defined period of time. The pre-defined period of timemay increase as the confidentiality or sensitivity (e.g., medicalrecords) of the content elevates. Also, according to an alternativeimplementation, an increased portion (e.g., 50%) of the mobile devicescreen 102 (FIG. 1) may be obfuscated by activating a larger number ofnarrow-angle sub-pixel units 206A-C (FIG. 2B) at different locations onthe screen. More specifically, in addition to activating thenarrow-angle sub-pixel units 206A-C (FIG. 2B) for obfuscating thesensitive or confidential content, additional narrow-angle sub-pixelunits 206A-C (FIG. 2B) are activated at other regions or portions of themobile device screen 102 (FIG. 1).

If at 510B an external camera device image is not detected within thefield of view of the mobile device camera, without IR backgroundactivation, at 514 the received content (502) is displayed bydeactivating the wide-angle sub-pixel units at the identified pixelpositions associated with the portions of the screen that will displaythe sensitive or confidential content and activating the narrow-anglesub-pixel units at the identified pixel positions associated with theportions of the screen that will display the sensitive or confidentialcontent. For example, the mobile device 101 (FIG. 1) may deactivatewide-angle sub-pixel units 204A-C (FIG. 2B) and activate narrow-anglesub-pixel units 206A-C (FIG. 2B) in order to decrease the viewing angleof the mobile device screen 102 (FIG. 1) at the pixel positions of thesensitive or confidential content (514). Thus, by narrowing the field ofview based on activating narrow-angle sub-pixel units 206A-C (FIG. 2B),the sensitive content at the pixel positions of narrow-angle sub-pixelunits 206A-C (FIG. 2B) appear obfuscated (e.g., dark and unreadable) tothe one or more unauthorized users 106 (FIG. 1) attempting to view thescreen 102.

In order to display the content, the one or more authorized users 104(FIG. 1) may be required to fill a certain portion of the captured imagearea or the mobile device camera's 103 (FIG. 1) field of view. Forexample, a certain portion (e.g., >70%) of the screen's 102 (FIG. 1)pixels corresponding to the captured image area may be required to beoccupied by the image of each user captured by the camera 103. Thisprocess, among other things, increases the precision in the userdetection process (i.e., authorized or unauthorized user) in subsequentprocesses and mitigates the probability of another user (i.e.,authorized or unauthorized user) being able to view the display screen102 without actually appearing in the image captured by the mobiledevice camera 103. In some implementations, a single user may berequired to fill a certain portion of the viewing screen of the mobiledevice camera 103 (FIG. 1). In other implementations, two or more usersup to a predetermined limit (e.g., 3 users) may be required to fill acertain portion of the viewing screen of the mobile device camera 103(FIG. 1) during the authorized viewer detection process.

Process 500 (FIG. 5A) thus provides a closed loop adaptive directionalmobile device screen permitting limited viewing at a specified cone ofviewing based on detecting sensitive or confidential content. Thesub-pixels units of the mobile device screen each include one or more IRemitters that saturate the image sensors of external cameras that may beused to capture an image of the mobile device screen, whereby thepresence of the external camera and one or more unauthorized users isdetected by an embedded camera within the mobile device. Moreover, beamsteering optics within the mobile device screen and image recognitiontechniques for detecting authorized users may be utilized tocontinuously steer the displayed output from the mobile device screentoward the authorized user along a generated narrower cone of viewing.As depicted in FIGS. 5A and 5B, the closed loop process of detectingauthorized users/external-cameras, activating countermeasures based onthe detected external cameras, generating a narrower viewing cone usingthe narrow-angle sub-pixel units 206A-206B for sensitive or confidentialcontent, and steering the narrower viewing cone of the screen to anauthorized user is accomplished by processes 502-530. The processingsteps of FIGS. 5A and 5B may be carried out by one or more processingunits within mobile device 101 (FIG. 1). An exemplary embodiment of theone or more processing units within mobile device 101 (FIG. 1) areillustrated and described in relation to the one or more processors 820of FIG. 6.

FIG. 5B depicts a flowchart of processes 510A and 510B for determiningone or more unauthorized viewers and/or external camera devices withinthe process of FIG. 5A, according to an embodiment. FIG. 5B may bedescribed with the aid of the exemplary embodiment of FIG. 1.

At 520, an image is generated for each of the one or more users andexternal image capture devices (e.g., an external camera) within theimage captured by the camera. In operation, mobile device 101 (FIG. 1)may utilize camera 103 (FIG. 1) in order to generate images of one ormore authorized users 104 (FIG. 1) and one or more unauthorized users106 (FIG. 1) within the captured image 506 (FIG. 5A). At 520, an imageof an external camera device 109 (FIG. 1) may also be generated,provided the external camera device 109 (FIG. 1) is present within thecaptured image 506.

At 520, in order to generate the image, the one or more users may berequired to fill a certain portion of the captured image area or themobile device camera's 103 (FIG. 1) field of view. For example, acertain portion (e.g., >70%) of the screen's 102 (FIG. 1) pixelscorresponding to the captured image area may be required to be occupiedby the image of each user captured by the camera 103. This process,among other things, increases the precision in the user detectionprocess (i.e., authorized or unauthorized user) in subsequent processesand mitigates the probability of another user (i.e., authorized orunauthorized user) being able to view the display screen 102 withoutactually appearing in the image captured by the mobile device camera103. In some implementations, a single user may be required to fill acertain portion of the viewing screen of the mobile device camera 103(FIG. 1). In other implementations, two or more users up to apredetermined limit (e.g., 3 users) may be required to fill a certainportion of the viewing screen of the mobile device camera 103 (FIG. 1)during the authorized viewer detection process.

At 522, the generated image of each of the one or more users within thecaptured image (506) are compared to reference images corresponding toauthorized users having viewing privileges for the sensitive orconfidential content being displayed on the mobile device screen. Alsoat 522, the generated image of one or more external camera devices(e.g., external camera device 109: FIG. 1) are compared to referenceimages corresponding to various camera device make and models. Inoperation, mobile device 101 (FIG. 1) may compare the images generatedfrom the image captured by camera 103 (FIG. 1) to one or more referenceimages in order to generate a correlation factor corresponding to themeasure of similarity between the generated images (e.g., users andimage capture devices) and reference images (e.g., authorized users anddifferent camera devices). It may be appreciated that the one or morereferences may be stored in any electronic form, such as locally onmobile device 101 or using a cloud-based service that mobile device 101may access.

At 524, a correlation factor corresponding to the degree of similaritybetween the generated images and the reference images is compared to athreshold value. In operation, mobile device 101 (FIG. 1) may use thecomparison of the images captured by camera 103 (FIG. 1) to the one ormore reference images to generate a correlation factor corresponding tothe comparison. For example, a correlation factor generated by an imageof authorized user 104 (FIG. 1) may have a higher value than acorrelation factor generated by an image of unauthorized user 106 (FIG.1). Similarly, a correlation factor generated by the image of theexternal camera 109 (FIG. 1) may have a higher value than a correlationfactor generated by a captured image of a non-camera device.

At 526, if there is at least one correlation factor associated with theuser images that is less than the threshold value, there are someunauthorized users attempting to view the screen. In operation,unauthorized user 106 (FIG. 1) may be within viewing region 108 (FIG. 1)and may attempt to view the content displayed on mobile device screen102 (FIG. 1). Unauthorized user 106 may subsequently be detected bycamera 103 (FIG. 1) and an image may be captured by camera 103 andcompared to a reference image by mobile device 101 (FIG. 1). Mobiledevice 101 may then determine that at least one correlation factor isless than the threshold value and may attempt to protect the sensitiveor confidential content.

At 528, if the correlation factor is at, or above, the threshold value,all users are authorized users. In operation, authorized user 104(FIG. 1) may be the only viewer of the content on mobile device screen102 (FIG. 1). Mobile device 101 (FIG. 1) may then determine that nocorrelation factor is less than the threshold value. In an alternativeimplementation, multiple authorized users may be designated as havingviewing privileges associated with the sensitive or confidential contentdisplayed on mobile device screen 102.

At 530, if the correlation factor associated with detecting an externalcamera device is less than a threshold value designated for an externalcamera device, then no external camera is detected. Conversely, if thecorrelation factor associated with detecting the external camera deviceis at or above the threshold value designated for the external cameradevice, then the external camera is detected. For example, an image ofexternal camera 109 (FIG. 1) may be captured by camera 103 (FIG. 1) andcompared to a reference image of one or more cameras by mobile device101 (FIG. 1). Mobile device 101 then determines that the correlationfactor associated with the comparison is higher than a designatedthreshold value due to the presence of the camera device 109 (FIG. 1)within the captured image. As such, the mobile device 101 will protectthe sensitive or confidential content (e.g., FIGS. 4A and 4B: 406) usingthe countermeasures facilitated by the IR sub-pixel units 208 (FIG. 2B).

The present invention may be a system, a method, and/or a computerprogram product. The computer program product may include a computerreadable storage medium (or media) having computer readable programinstructions thereon for causing a processor to carry out aspects of thepresent invention.

The computer readable storage medium can be a tangible device that canretain and store instructions for use by an instruction executiondevice. The computer readable storage medium may be, for example, but isnot limited to, an electronic storage device, a magnetic storage device,an optical storage device, an electromagnetic storage device, asemiconductor storage device, or any suitable combination of theforegoing. A non-exhaustive list of more specific examples of thecomputer readable storage medium includes the following: a portablecomputer diskette, a hard disk, a random access memory (RAM), aread-only memory (ROM), an erasable programmable read-only memory (EPROMor Flash memory), a static random access memory (SRAM), a portablecompact disc read-only memory (CD-ROM), a digital versatile disk (DVD),a memory stick, a floppy disk, a mechanically encoded device such aspunch-cards or raised structures in a groove having instructionsrecorded thereon, and any suitable combination of the foregoing. Acomputer readable storage medium, as used herein, is not to be construedas being transitory signals per se, such as radio waves or other freelypropagating electromagnetic waves, electromagnetic waves propagatingthrough a waveguide or other transmission media (e.g., light pulsespassing through a fiber-optic cable), or electrical signals transmittedthrough a wire.

Computer readable program instructions described herein can bedownloaded to respective computing/processing devices from a computerreadable storage medium or to an external computer or external storagedevice via a network, for example, the Internet, a local area network, awide area network and/or a wireless network. The network may comprisecopper transmission cables, optical transmission fibers, wirelesstransmission, routers, firewalls, switches, gateway computers and/oredge servers. A network adapter card or network interface in eachcomputing/processing device receives computer readable programinstructions from the network and forwards the computer readable programinstructions for storage in a computer readable storage medium withinthe respective computing/processing device.

Computer readable program instructions for carrying out operations ofthe present invention may be assembler instructions,instruction-set-architecture (ISA) instructions, machine instructions,machine dependent instructions, microcode, firmware instructions,state-setting data, or either source code or object code written in anycombination of one or more programming languages, including an objectoriented programming language such as Smalltalk, C++ or the like, andconventional procedural programming languages, such as the “C”programming language or similar programming languages. The computerreadable program instructions may execute entirely on the user'scomputer, partly on the user's computer, as a stand-alone softwarepackage, partly on the user's computer and partly on a remote computeror entirely on the remote computer or server. In the latter scenario,the remote computer may be connected to the user's computer through anytype of network, including a local area network (LAN) or a wide areanetwork (WAN), or the connection may be made to an external computer(for example, through the Internet using an Internet Service Provider).In some embodiments, electronic circuitry including, for example,programmable logic circuitry, field-programmable gate arrays (FPGA), orprogrammable logic arrays (PLA) may execute the computer readableprogram instructions by utilizing state information of the computerreadable program instructions to personalize the electronic circuitry,in order to perform aspects of the present invention.

Aspects of the present invention are described herein with reference toflowchart illustrations and/or block diagrams of methods, apparatus(systems), and computer program products according to embodiments of theinvention. It will be understood that each block of the flowchartillustrations and/or block diagrams, and combinations of blocks in theflowchart illustrations and/or block diagrams, can be implemented bycomputer readable program instructions.

These computer readable program instructions may be provided to aprocessor of a general purpose computer, special purpose computer, orother programmable data processing apparatus to produce a machine, suchthat the instructions, which execute via the processor of the computeror other programmable data processing apparatus, create means forimplementing the functions/acts specified in the flowchart and/or blockdiagram block or blocks. These computer readable program instructionsmay also be stored in a computer readable storage medium that can directa computer, a programmable data processing apparatus, and/or otherdevices to function in a particular manner, such that the computerreadable storage medium having instructions stored therein comprises anarticle of manufacture including instructions which implement aspects ofthe function/act specified in the flowchart and/or block diagram blockor blocks.

The computer readable program instructions may also be loaded onto acomputer, other programmable data processing apparatus, or other deviceto cause a series of operational steps to be performed on the computer,other programmable apparatus or other device to produce a computerimplemented process, such that the instructions which execute on thecomputer, other programmable apparatus, or other device implement thefunctions/acts specified in the flowchart and/or block diagram block orblocks.

The flowchart and block diagrams in the Figures illustrate thearchitecture, functionality, and operation of possible implementationsof systems, methods, and computer program products according to variousembodiments of the present invention. In this regard, each block in theflowchart or block diagrams may represent a module, segment, or portionof instructions, which comprises one or more executable instructions forimplementing the specified logical function(s). In some alternativeimplementations, the functions noted in the block may occur out of theorder noted in the figures. For example, two blocks shown in successionmay, in fact, be executed substantially concurrently, or the blocks maysometimes be executed in the reverse order, depending upon thefunctionality involved. It will also be noted that each block of theblock diagrams and/or flowchart illustration, and combinations of blocksin the block diagrams and/or flowchart illustration, can be implementedby special purpose hardware-based systems that perform the specifiedfunctions or acts or carry out combinations of special purpose hardwareand computer instructions.

FIG. 6 shows a block diagram of the components of a data processingsystem 800, 900, that may be incorporated within mobile device 101(FIG. 1) in accordance with an illustrative embodiment of the presentinvention. It should be appreciated that FIG. 6 provides only anillustration of one implementation and does not imply any limitationswith regard to the environments in which different embodiments may beimplemented. Many modifications to the depicted environments may be madebased on design and implementation requirements.

Data processing system 800, 900 is representative of any electronicdevice capable of executing machine-readable program instructions. Dataprocessing system 800, 900 may be representative of a smart phone, acomputer system, PDA, or other electronic devices. Examples of computingsystems, environments, and/or configurations that may represented bydata processing system 800, 900 include, but are not limited to,personal computer systems, server computer systems, thin clients, thickclients, hand-held or laptop devices, multiprocessor systems,microprocessor-based systems, network PCs, minicomputer systems, anddistributed cloud computing environments that include any of the abovesystems or devices.

The data processing system 800, 900 may include may include a set ofinternal components 800 and a set of external components 900 illustratedin FIG. 6. The set of internal components 800 includes one or moreprocessors 820, one or more computer-readable RAMs 822 and one or morecomputer-readable ROMs 824 on one or more buses 826, and one or moreoperating systems 828 and one or more computer-readable tangible storagedevices 830. The one or more operating systems 828 and programs such asMobile Device Screen Content-Protection (MDSC) Program 500 is stored onone or more computer-readable tangible storage devices 830 for executionby one or more processors 820 via one or more RAMs 822 (which typicallyinclude cache memory). In the embodiment illustrated in FIG. 6, each ofthe computer-readable tangible storage devices 830 is a magnetic diskstorage device of an internal hard drive. Alternatively, each of thecomputer-readable tangible storage devices 830 is a semiconductorstorage device such as ROM 824, EPROM, flash memory or any othercomputer-readable tangible storage device that can store a computerprogram and digital information.

The set of internal components 800 also includes a R/W drive orinterface 832 to read from and write to one or more portablecomputer-readable tangible storage devices 936 such as a CD-ROM, DVD,memory stick, magnetic tape, magnetic disk, optical disk orsemiconductor storage device. The MDSC program 500 can be stored on oneor more of the respective portable computer-readable tangible storagedevices 936, read via the respective R/W drive or interface 832 andloaded into the respective hard drive 830.

The set of internal components 800 may also include network adapters (orswitch port cards) or interfaces 836 such as a TCP/IP adapter cards,wireless wi-fi interface cards, or 3G or 4G wireless interface cards orother wired or wireless communication links. MDSC program 500 can bedownloaded from an external computer (e.g., server) via a network (forexample, the Internet, a local area network or other, wide area network)and respective network adapters or interfaces 836. From the networkadapters (or switch port adaptors) or interfaces 836, the MDSC program500 is loaded into the respective hard drive 830. The network maycomprise copper wires, optical fibers, wireless transmission, routers,firewalls, switches, gateway computers and/or edge servers.

The set of external components 900 can include a computer displaymonitor 920, a keyboard 930, and a computer mouse 934. Externalcomponent 900 can also include touch screens, virtual keyboards, touchpads, pointing devices, and other human interface devices. The set ofinternal components 800 also includes device drivers 840 to interface tocomputer display monitor 920, keyboard 930 and computer mouse 934. Thedevice drivers 840, R/W drive or interface 832 and network adapter orinterface 836 comprise hardware and software (stored in storage device830 and/or ROM 824).

As depicted in FIG. 6, the one or more processors 820 (i.e., one or moreprocessing units) may be located within the mobile device 101 (FIG. 1)for executing the processes of FIGS. 5A and 5B, while the externaldisplay monitor 920 coupled to the one or more processors 820 mayinclude the integrated mobile device screen 102 (FIG. 1) having theadaptive directional display capabilities corresponding to FIG. 2B. Theone or more processors 820 may include a single processor device thatoperates the mobile device 101 (FIG. 1), executes the MDSC program 500,and drives mobile device screen 102 (FIG. 1). The one or more processors820 may alternatively include multiple processors, whereby one of themultiple processors provides image processing by, among other things,executing the MDSC program 500, while the other processor carries outprocessing activities (e.g., camera operation) for the operation of themobile device 101 (FIG. 1).

The following described embodiments enhance the operation of a genericcomputer by providing content-based control over the viewingcapabilities of a computerized display screen. More specifically, theabove-described processes analyze information that is going to bedisplayed on a mobile device screen in order to modify the displaycharacteristics of the screen based on identifying sensitive orconfidential content within the information that is going to be display.

The descriptions of the various embodiments of the present inventionhave been presented for purposes of illustration, but are not intendedto be exhaustive or limited to the embodiments disclosed. Manymodifications and variations will be apparent to those of ordinary skillin the art without departing from the scope and spirit of the describedembodiments. The terminology used herein was chosen to best explain theprinciples of the one or more embodiment, the practical application ortechnical improvement over technologies found in the marketplace, or toenable others of ordinary skill in the art to understand the embodimentsdisclosed herein.

What is claimed is:
 1. A system for protecting content comprising: amobile device screen including a plurality of pixels, each of theplurality of pixels having both first sub-pixel units that include afirst viewing angle and second sub-pixel units that include a secondviewing angle, wherein within each of the plurality of pixels the firstsub-pixel units are adjacent to the second sub-pixel units; and aprocessing unit coupled to the mobile device screen, the processing unitdetermining at least a portion of the mobile device screen that displayssensitive content, the processing unit obscuring the sensitive contentdisplayed on the at least a portion of the mobile device screen bydeactivating the first sub-pixel units including the first viewing angleat the portion of the mobile device screen that displays the sensitivecontent and activating the second sub-pixel units including the secondviewing angle at the portion of the mobile device screen that displaysthe sensitive content.
 2. The system of claim 1, further comprising aninfrared (IR) light emitter embedded in the mobile device screen,wherein the IR light emitter is activated and deactivated by theprocessing unit.
 3. The system of claim 2, further comprising: a firstcamera device or set of camera devices coupled to the processing unit,wherein based on the first camera device or set of camera devicesdetecting a second camera device or set of camera devices, the IR lightemitter generates an infrared signal that saturates an image sensor ofthe second camera device or set of camera devices.
 4. The system ofclaim 1, further comprising: a camera device coupled to the processingunit, the camera device detecting one or more unauthorized users viewingthe mobile device screen, wherein based on the camera device detectingthe one or more unauthorized users viewing the mobile device screen, theprocessing unit obscures the sensitive content displayed on all portionsof the mobile device screen by deactivating the first sub-pixel unitsand deactivating the second sub-pixel units.
 5. The system of claim 2,wherein the IR light emitter includes one or more IR light emittingdiodes located within the each of the plurality of pixels.
 6. The systemof claim 2, wherein the IR light emitter includes one or more IR lightemitting diodes that are embedded either within a peripheral portion ofthe mobile device screen or stacked under the plurality of pixels. 7.The system of claim 1, wherein each of the second sub-pixel units thatinclude the second viewing angle comprise a collimator lens thatcollimates a diverging light output from the respective second sub-pixelunits.
 8. The system of claim 1, wherein each of the second sub-pixelunits that include the second viewing angle comprise an optical beamsteering mechanism for directing an optical output of the each of thesecond sub-pixel units towards an authorized viewer of the displayedsensitive content.
 9. The system of claim 1, wherein the second viewingangle has a smaller viewing angle relative to the first viewing anglefor visually obscuring the sensitive content at viewing angles thatexceed the second viewing angle.
 10. The system of claim 1, wherein thefirst sub-pixel units that include the first viewing angle each includea first red light emitting diode, a first green light emitting diode,and a first blue light emitting diode, and wherein the second sub-pixelunits that include the second viewing angle each include a second redlight emitting diode, a second green light emitting diode, and a secondblue light emitting diode, wherein the second viewing angle has asmaller viewing angle relative to the first viewing angle for visuallyobscuring the sensitive content at viewing angles that exceed the secondviewing angle.
 11. A method of protecting content displayed on a mobiledevice screen, the method comprising: receiving content to be displayedon the mobile device screen, wherein the received content containssensitive content and non-sensitive content; detecting an image of oneor more authorized users viewing the mobile device screen; andgenerating, based on the detected image of the one or more authorizedusers, an image of the received content on the mobile device screenusing a plurality of pixels, the plurality of pixels each having bothfirst sub-pixel units that include a first viewing angle and secondsub-pixel units that include a second viewing angle, the first sub-pixelunits generating an image of the non-sensitive content on the mobiledevice screen at the first viewing angle and the second sub-pixel unitsgenerating an image of the sensitive content on the mobile device screenat the second viewing angle, wherein the second viewing angle has asmaller viewing angle relative to the first viewing angle for obscuringthe sensitive content.
 12. The method of claim 11, further comprising:detecting an image of an external camera device used to capture theimage of the received content displayed on the mobile device screen; andgenerating an infrared (IR) signal that saturates an image sensor of theexternal camera device used to capture the image displayed on the mobiledevice screen, wherein the IR signal is generated based on bothdetecting the image of the external camera device and determining thatthe detected image of the one or more authorized users only includes theone or more authorized users.
 13. The method of claim 11, furthercomprising: detecting an image of one or more unauthorized users viewingthe mobile device screen; and generating, based on the detected one ormore unauthorized users, a blank image on the mobile device screen. 14.The method of claim 11, wherein the second viewing angle includes adiverted optical output from the activated second sub-pixel unitstowards an authorized viewer of the sensitive content, and wherein thefirst viewing angle includes a non-diverted optical output from theactivated first sub-pixel units, wherein the diverted optical outputfrom the activated second sub-pixel units towards the authorized viewerof the sensitive content is generated based on a facial recognitiontechnique identifying the position of the authorized viewer relative tothe mobile device screen.
 15. The method of claim 11, wherein theinfrared signal is generated by one or more infrared light emittingdiodes located adjacent each of the plurality of pixels having both thefirst sub-pixel units and the second sub-pixel units.
 16. The method ofclaim 15, wherein the infrared signal generated by the one or moreinfrared light emitting diodes overlap visible light from the secondsub-pixel units associated with the generated image of the sensitivecontent on the mobile device screen.
 17. The method of claim 12, whereina flux of photons corresponding to the one or more infrared lightemitting diodes that emit the infrared (IR) light is about one hundredtimes larger than a flux of photons corresponding to visible light fromthe first sub-pixel units.
 18. The method of claim 11, wherein thedetecting of the one or more unauthorized users comprises: capturing,using a camera, an image of a user viewing the mobile device screen;correlating the captured image to one or more reference imagesassociated with authorized users; determining a correlation factor basedon the comparing of the captured image to the one or more referenceimages; and detecting the user viewing the mobile device screen as anunauthorized user based on the correlation factor being below areference correlation factor.
 19. A system for protecting contentcomprising: a mobile device screen including a plurality of pixels, eachof the plurality of pixels having both first sub-pixel units that emitvisible light and second sub-pixel units that emit infrared (IR) light,wherein within each of the plurality of pixels the first sub-pixel unitsare adjacent to the second sub-pixel units; and a processing unitcoupled to the mobile device screen, the processing unit determining atleast a portion of the mobile device screen that displays sensitivecontent, the processing unit obscuring the sensitive content displayedon the at least a portion of the mobile device screen by activating thesecond sub-pixel units at the portion of the mobile device screen thatdisplays the sensitive content.
 20. The system of claim 19, wherein aflux of photons corresponding to the second sub-pixel units that emitthe infrared (IR) light is about one hundred times larger than a flux ofphotons corresponding to the first sub-pixel units that emit the visiblelight.